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COMPRESSED MOVING PICTURE RE-ENCODING APPARATUS 
AND COMPRESSED MOVING PICTURE RE-ENCODING METHOD 

BACKGROUND OF THE INVENTION 
The present invention relates to a compressed moving picture re- 
encoding apparatus and compressed moving picture re-encoding method, 
and relates in particular to a compressed moving picture re-encoding 
5 apparatus and compressed moving picture re-encoding method that 
reduce a number of bits of a compressed moving picture constituting an 
input signal. 
Prior Art 

When a video bit stream is transmitted and stored by such digital 

10 broadcast systems and services, etc., the video bit stream is compressed 
before being transmitted and stored. Also, recently ISO/ICE IS13818- 
2 (MPEG-2 VIDEO) and the like have been standardized as video bit 
stream(video bit stream) compression methods, and are used in digital 
broadcast systems and services, etc. 

15 On the other hand, in broadcasting stations or in the home, 

applications are anticipated by which a compressed moving picture 
stream compressed at a prescribed bit rate is transmitted or stored after 
being re-encoded as a compressed moving picture stream with a 
different bit rate. As an example, there is a function for recording 

20 pictures onto digital recording apparatuses. 

A compressed moving picture stream distributed from a 
broadcasting station to the home is encoded at a prescribed bit rate. 
When a compressed moving picture stream is distributed to a limited 
storage capacity for the purpose of allowing the viewer an extended 

25 recording time, for example, it is necessary to re-code the compressed 
moving picture stream at a lower bit rate than that at which it was 
distributed. In this case, it is desirable to suppress deterioration in the 
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picture quality when re-encoding is performed. Below, the prior art 
relating to such re-encoding processing of a compressed moving picture 
stream will be described in particular. 

In the following description, the compressed moving picture 
5 stream is assumed to be compressed in accordance with MPEG-2 VIDEO. 
The following description thus applies to an MPEG-2 bit stream. With 
MPEG-2 VIDEO, a picture is divided into blocks consisting of groups of 
pixels, and space domain signals are converted to frequency domain 
signals by executing a Discrete Cosine Transform (DOT) on each block. 

10 Each frequency component obtained by means of this Discrete Cosine 
Transform is quantized with a defined quantizer step size, subjected to 
variable length encoding by allocating a variable length code to the 
quantization conversion coefficient, and output as an MPEG-2 bit 
stream. A compressed moving picture re-encoding apparatus basically 

15 implements its function by de-encoding the MPEG-2 bit stream, which 
is the input signal, to a video bit stream, and re-encoding the de- 
encoded video bit stream. A compressed moving picture re-encoding 
apparatus is therefore configured by a decoder and coder connected in 
series. 

20 Fig. 12 shows the basic configuration of a decoder. The decoder 

shown in Fig. 12 is configured by a variable length decoder 201, an 
inverse quantizer 202, an inverse discrete cosine transformer 203, an 
adder 204, a frame memory 205, and a motion compensation predictor 
206. 

25 Fig. 13 shows the basic configuration of a coder. The coder shown 

in Fig. 13 is configured by a subtracter 301, a discrete cosine 
transformer 302, a quantizer 303, a variable length coder 304, rate 
control control means 305, an inverse quantizer 306, an inverse discrete 
cosine transformer 307, an adder 308, a frame memory 309, and a 

30 motion compensation predictor 310. Fig. 14 shows the basic 




configuration of a compressed moving picture re-encoding apparatus. 
Below, for purposes of explanation, the variable length decoder 201 and 
inverse quantizer 202 are designated the de-encoding path section 41, 
the quantizer 303 and variable length coder 304 are designated the 
5 encoding path section 43, and the component sections other than the 
deencoding path section 41, encoding path section 43, and rate control 
control means 401, are designated the error compensation section 42. 

Since, as stated above, the compressed moving picture re-encoding 
apparatus shown in Fig. 14 is configured by a decoder and a coder 

10 connected in series, the decoder shown in Fig. 12 and the coder shown in 
Fig. 13 are connected in series. Also, for the purposes of achieving 
high-speed processing and improved picture quality, the compressed 
moving picture re-encoding apparatus re-uses the encoding information 
de-encoded by the variable length decoder 201 as a encoding parameter 

15 when performing re-encoding. 

In contrast to this, an apparatus that performs re-encoding of 
compressed moving pictures simply and at lower cost is disclosed in 
Japanese Patent Laid-Open No, 8-23539, Japanese Patent Laid-Open 
No. 8-51631, and so forth. Fig. 15 shows the basic configuration of the 

20 compressed moving picture re-encoding apparatus disclosed in Japanese 
Patent Laid-Open No. 8-23539. In order to simplify the processing, the 
compressed moving picture re-encoding apparatus shown in Fig. 15 has 
a configuration that omits the error compensation section 42 in Fig. 14, 
and is configured by a de-encoding path 51, a encoding path 52, and a 

25 rate control controller 501, only. However, when this apparatus is 
used, picture quality degradation occurs because of the accumulation of 
quantization error due to re-quantization. 

Fig. 16 shows the basic configuration of the compressed moving 
picture re-encoding apparatus disclosed in Japanese Patent Laid-Open 

30 No. 8-51631. The compressed moving picture re-encoding apparatus 
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shown in Fig. 16 achieves simplification of the processing by using an 
error compensation section 62 equivalent in terms of conversion to the 
error compensation section 42 in Fig. 14. 

These examples of the prior art are items disclosed with regard to 
5 the configuration of a compressed moving picture re-encoding apparatus, 
and have not been described in relation to rate control in the rate 
control means 401. Next, the prior art for the code rate control method 
of a compressed moving picture re-encoding apparatus will be described. 
As prior art example 1, the method of the MPEG-2 test model (Test 

10 Model 5, ISO/ICE JTC1/SC21/WG11/N0400, April 1993), which is a code 
rate control method for a encoding apparatus, is known. With this 
method, a defined-bit-rate encoding method is used that attempts to 
define the number of bits, generated by intra-frame encoding and inter- 
frame predictive encoding, every given unit time. As a result, taking a 

15 GOP (Group Of Pictures) as the unit, the number of bits is controlled by 
setting the base quantizer step size that is set for each macro block unit 
whereby the pictures are divided into 16 x 16 pixels, so that the number 
of bits generated by encoding processing for each GOP is defined. 

However, as the above described prior art example 1 is a code rate 

20 control method for a encoding apparatus, and information that is not 
contained in the MPEG-2 bit stream is necessary for control, it cannot 
be applied directly. In this respect, a code rate control method suited 
to a compressed moving picture re-encoding apparatus has been 
proposed in place of the code rate control method in the above described 

25 prior art example 1. For example, as prior art example 2, the code rate 
control method in the compressed moving picture re-encoding apparatus 
shown in Fig. 15 is disclosed in United States Patent 5,657,015. 

With this method, the base quantizer step size is set from the 
picture average quantizer step size after re-encoding, the picture target 

30 number of bits, and the actual number of bits, for each macro block. 



Next, rate control is performed by computing the activity using the 
picture average quantizer step size, the ratio of the quantizer step size, 
or the number of bits of picture, of the macro block for which encoding is 
performed, and the ratio of the number of bits of the macro block for 
5 which encoding is performed, and adjusting the base quantizer step 
size. 

As prior art example 3, United States Patent 5,805,224 is disclosed. 
With this method, the sub-picture target number of bits at the time of 
re-encoding is set from the input bit rate, the output bit rate, and the 

10 number of bits of the picture for which encoding is performed, and the 
picture complexity measure is found from the product of the number of 
bits and the quantizer step size. Next, the complexity measure is 
distributed according to the sub-picture target generated a number of 
bits, and the sub-picture quantizer step size is set. Then, the 

15 difference between the target number of bits and the actual number of 
bits is reflected in the control, and the number of bits adjustment is 
performed by adjusting the quantizer step size. In prior art example 2 
and prior art example 3, the target number of bits at the time of re- 
encoding is set using the number of bits of the input compressed moving 

20 picture stream picture, the input bit rate, and the output bit rate. 

SUMMARY OF THE INVENTION 
However, with the above described methods in the prior art, since 
the target number of bits at the time of re-encoding is set in accordance 
25 with the number of bits of the input compressed moving picture stream, 
and the generated number of bits is reduced virtually uniformly 
regardless of the moving picture scene characteristics or the number of 
bits necessary for encoding, these methods are attended by the problem 
of picture quality degradation. 
30 It is an object of the present invention to provide a compressed 
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moving picture re-encoding apparatus and a compressed moving picture 
re-encoding method that realize shortening of the processing delay, 
improvement of the picture quality, and improvement of the encoding 
efficiency, when compressed moving picture re-encoding is performed. 
5 Further, it is an object of the present invention to provide a compressed 
moving picture re-encoding apparatus and a compressed moving picture 
re-encoding method that realize moving picture data re-encoding more 
efficiently and with a higher picture quality in a compressed moving 
picture data re-encoding apparatus that is capable of real-time 
10 processing. 

To achieve the above objects, the compressed moving picture re- 
encoding apparatus of the present invention has an input compressed 
moving picture stream, generated by compression of moving picture 
data, as an input signal, performs re-encoding at a pre-set average bit 

15 rate and at a variable bit rate, and has an output compressed moving 
picture stream whose bit rate has been changed as an output signal; and 
comprises means for computing the quantizer step size that is used in 
re-encoding, and means for inputting the computed quantizer step size, 
and the quantizer step size in the input compressed moving picture 

20 stream, and outputting the quantizer step size that is used in actual 
re-encoding. 

Also, it is desirable that the compressed moving picture re- 
encoding apparatus further comprises means for selecting the larger 
quantizer step size from the above described quantizer step size used in 

25 re-encoding and the above described quantizer step size in the input 
compressed moving picture stream, means for computing the respective 
complexity measures in two or more kinds of prescribed predetermined 
periods or numbers of pictures, using either or both of the quantizer 
step size and the number of bits in either the input compressed moving 

30 picture stream or the re-enencoded compressed moving picture stream. 



means for outputting a prescribed complexity measure from a plurality 
of complexity measures, and means for computing the quantizer step 
size using a pre-set average bit rate and the output complexity measure, 
in which the quantizer step size is adjusted every prescribed period 
5 according to the difference (excess or deficiency) between the target 
number of bits and the actual number of bits, to give the quantizer step 
size that is used in re-encoding. 

In addition, it is desirable that pictures from a picture re-encoded 
at the start of re-encoding to a picture immediately preceding that for 

10 which re-encoding is currently being performed, or a plurality of 
pictures including one image encoded within a frame are used as a 
plurality of pictures used as the above prescribed period or number of 
pictures, a group of blocks into which a picture is divided is used for the 
prescribed period for adjusting the base quantizer step size according to 

15 excess or deficiency with respect to the target number of bits, and the 
compressed moving picture re-encoding apparatus further comprises 
means for selecting the minimum complexity measure among a plurality 
of complexity measures. 

Moreover, it is desirable that the compressed moving picture re- 

20 encoding apparatus comprises means for applying weighting, according 
to the image characteristics, to the quantizer step size used in the above 
described re-encoding, and adjusting that quantizer step size; means for 
computing the ratio of the complexity measure in a prescribed defined 
period or number of pictures to the complexity measure of the object of 

25 re-encoding, using either or both of the quantizer step size and the 
number of bits of the input compressed moving picture stream, 
performing weighting of the quantizer step size, and adjusting that 
quantizer step size; and further comprises means for computing the 
ratio of the respective complexity measures in a prescribed period or 

30 number of pictures to the complexity measure of the object of re- 
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encoding, using either or both of the quantizer step size and the number 
of bits of the input compressed moving picture stream, performing 
weighting of the quantizer step size, and adjusting that quantizer step 
size. 

5 Also, it is desirable that the compressed moving picture re- 

encoding apparatus comprises means for computing the respective 
complexity measures in two or more kinds of prescribed periods or 
numbers of pictures, using either or both of the quantizer step size and 
the number of bits of the above described input compressed moving 

10 picture stream; means for outputting a prescribed complexity measure 
from a plurality of complexity measures; means for computing the 
quantizer step size using a pre-set average bit rate and the output 
complexity measure; means for computing the average quantizer step 
size every prescribed period or number of pictures, using the quantizer 

15 step size of the input compressed moving picture stream; and means for 
computing an addition value using the quantizer step size and average 
quantizer step size, adding the addition value to the quantizer step size 
of the input compressed moving picture stream, and computing an 
addition quantizer step size, in which the addition quantizer step size is 

20 adjusted every prescribed period according to the difference (excess or 
deficiency) between the target number of bits and the actual number of 
bits, to give the quantizer step size that is used in re-encoding. 

In addition, it is desirable that the compressed moving picture re- 
encoding apparatus comprises means for computing the respective 

25 complexity measures in two or more kinds of prescribed periods or 
numbers of pictures, using either or both of the quantizer step size and 
the number of bits of the above described input compressed moving 
picture stream; means for outputting a prescribed complexity measure 
from a plurality of complexity measures; means for computing the 

30 quantizer step size using a pre-set average bit rate and the output 



complexity measure; means for computing the average of the respective 
quantizer step sizes every prescribed period or number of pictures, 
according to the encoding prediction mode of the input compressed 
moving picture stream, using the quantizer step size of the input 
5 compressed moving picture stream; means for computing an addition 
value for each encoding prediction mode, using the quantizer step size 
and average quantizer step size, adding the addition value to the 
quantizer step size of the input compressed moving picture stream, and 
computing an addition quantizer step size, in which the addition 
10 quantizer step size is adjusted every prescribed period according to the 
difference (excess or deficiency) between the target number of bits and 
the actual number of bits, to give the quantizer step size that is used in 
re-encoding. 

Moreover, it is desirable that the compressed moving picture re- 
15 encoding apparatus comprises means for making a threshold setting for 
a prescribed plurality of quantizer step sizes with respect to said 
addition quantizer step size, and computing, by using the maximum bit 
rate among the set bit rates and either or both of the quantizer step size 
and the number of bits of the input compressed moving picture stream, 
20 the maximum bit rate quantizer step size at the maximum bit rate; and 
means for taking the maximum bit rate quantizer step size and the 
quantizer step size that is used in re-encoding as input, and outputting 
the quantizer step size that is used in re-encoding, in which the means 
for computing the maximum bit rate quantizer step size is rate control 
25 that satisfies the ratio of the input bit stream bit rate to the maximum 
bit rate with respect to the number of bits in the prescribed period or 
number of pictures of the input compressed moving picture stream, and 
for the minimum value to be set for the quantizer step size that is used 
in re-encoding. 

30 The compressed moving picture re-encoding method of the present 
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invention has an input compressed moving picture stream, generated by 
compression of moving picture data, as an input signal, performs re- 
encoding at a pre-set average bit rate and at a variable bit rate, and has 
an output compressed moving picture stream whose bit rate has been 
5 changed as an output signal; and comprises a step of computing the 
quantizer step size that is used in re-encoding, and a step of inputting 
the computed quantizer step size and the quantizer step size in the 
input compressed moving picture stream, and outputting the quantizer 
step size that is used in actual re-encoding. 

10 Also, it is desirable to further comprise a step of selecting the 

larger quantizer step size from the above described quantizer step size 
that is used in re-encoding, and the quantizer step size in the input 
compressed moving picture stream; and to comprise a step of computing 
the respective complexity measures in two or more kinds of prescribed 

15 predetermined periods or numbers of pictures, using either or both of 
the quantizer step size and the number of bits, in either of the input 
compressed moving picture stream or re-enencoded compressed moving 
picture stream; a step of outputting a prescribed complexity measure 
from a plurality of said complexity measures; and a step of computing 

20 the quantizer step size using a pre-set average bit rate and the output 
complexity measure; and for the quantizer step size to be adjusted every 
prescribed period according to the difference (excess or deficiency) 
between the target number of bits and the actual number of bits, to give 
the quantizer step size that is used in re-encoding. 

25 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a block diagram showing a sample configuration of an 
embodiment of a compressed moving picture re-encoding apparatus 
according to the present invention; 
30 Fig. 2 is a block diagram showing a sample configuration of a 



compressed moving picture re-encoding apparatus according to a second 
embodiment; 

Fig. 3 is a block diagram showing a sample configuration of a 
compressed moving picture re-encoding apparatus according to a third 
5 embodinient; 

Fig. 4 is a block diagram showing a sample configuration of a 
compressed moving picture re-encoding apparatus according to a fourth 
embodiment; 

Fig. 5 is a block diagram showing a sample configuration of a 
10 compressed moving picture re-encoding apparatus according to a fifth 
embodiment; 

Fig. 6 is a block diagram showing a sample configuration of a 
compressed moving picture re-encoding apparatus according to a sixth 
embodiment; 

15 Fig. 7 is a block diagram showing a sample configuration of a 

compressed moving picture re-encoding apparatus according to a 
seventh embodiment; 

Fig. 8 is a block diagram showing a sample configuration of a 
compressed moving picture re-encoding apparatus according to an 
20 eighth embodiment; 

Fig. 9 is an explanatory graph of sample operation of quantizer 
step size setting means according to the eighth embodiment; 
Fig. 10 is an explanatory graph of the principle; 
Fig. 11 is an explanatory graph of the principle; 
25 Fig. 12 is a block diagram showing the configuration of a decoder 

according to the prior art; 

Fig. 13 is a block diagram showing the configuration of a coder 
according to the prior art; 

Fig. 14 is a block diagram showing a sample configuration of a 
30 compressed moving picture re-encoding apparatus according to the prior 



art; 

Fig. 15 is a block diagram showing a sample configuration of a 
compressed moving picture re-encoding apparatus according to the prior 
art; and 

5 Fig. 16 is a block diagram showing a sample configuration of a 

compressed moving picture re-encoding apparatus according to the prior 
art. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
10 Embodiments of a compressed moving picture re-encoding 

apparatus and a compressed moving picture re-encoding method 
according to the present invention will now be described in detail while 
referring to the accompanying drawings. When Fig. 1 to Fig. 11 are 
referred to, one embodiment of the compressed moving picture re- 
15 encoding apparatus and compressed moving picture re-encoding method 
of the present invention is indicated. 

First Embodiment 

Fig. 1 is a drawing for explaining a compressed moving picture re- 

20 encoding apparatus according to the present invention. Here, the use 
of MPEG-2 VIDEO is assumed as the compression encoding method, but 
the compression-encoding method is not limited to MPEG-2 VIDEO, and 
any method can be used as long as it is a compression-encoding method 
that performs rate control by means of the quantizer step size. For 

25 example, a method such as ISO/ICE ISl 1 172 (MPEG-1 VIDEO), or 
ITU-TH.261 or ITU-TH.263, can be used. Also, for the period for 
performing complexity measure computation, all pictures encoded from 
the start of encoding to the present, and a group of pictures consisting of 
a plurality of pictures, are taken, and a macro block unit is used as the 

30 period for adjusting the difference (excess or deficiency) between the 



target number of bits and the actual number of bits. 

This encoding unit only represents one example of an image 
encoding unit, and any unit can be used for the complexity measure 
computation period as long as it is a unit whereby defined-period 
5 picture quality is controlled, and, as a period for adjusting an excess or 
deficient quantity, as long as the unit is smaller than the period for 
performing complexity measure computation in order to perform finer 
control. Apart from this, as the picture group unit, there are a 
plurality of picture groups containing one image predicted within a 
10 frame, or one picture, or pictures in a given time, etc. Here, according 
1:3 to Fig. 1, a compressed moving picture re-encoding apparatus according 

ill to the present invention is configured by a de-encoding path section 11, 

;;n an error compensation section 12, a encoding path section 13, and rate 

control means 14, 

ill 15 First, an MPEG-2 bit stream is supplied to the de-encoding path 

is. section 11 as input. In the de-encoding path section 11, variable length 

JiJ de-encoding and inverse quantization of the input bit stream are 

performed, and the input bit stream bit rate and frame rate, the input 
O bit stream quantizer step size per macro block, and the input bit stream 

20 number of bits, are supplied to the rate control means 14. Also, in the 
de-encoding path section 11, a DCT coefficient and motion vector, etc., 
are supplied to the error compensation section 12, and encoding 
information that can be re-used in re-encoding is supplied to the 
encoding path section 13. 
25 In the error compensation section 12, the accumulation of error 

due to re-quantization is prevented using the pre-re-quantization DCT 
coefficient, motion vector, etc., supplied from the de-encoding path 
section 11, and the post-re-quantization DCT coefficient supplied from 
the encoding path section 13; and the DCT coefficient for performing 
30 re-quantization is supplied to the encoding path section 13. 



In the encoding path section 13, DCT coefficient re-quantization 
and re-encoding are performed and an output bit stream is output using 
the encoding information supplied from the de-encoding path section 11, 
the DCT coefficient supplied from the error compensation section 12, 
5 the quantizer step size supplied from the rate control means 14, and the 
target average bit rate supplied from outside; and the post-re-encoding 
number of bits is supplied to the rate control means 14. 

In the rate control means 14, the quantizer step size is computed 
using the bit rate and frame rate of the input bit stream supplied from 

10 the de-encoding path section 11, the input bit stream quantizer step size, 
the input bitstream number of bits, the post-re-encoding number of bits 
supplied from the encoding path section 13, and the target average bit 
rate supplied from outside; and is supplied to the encoding path section 
13. Here, the rate control means 14 is configured by complexity 

15 measure computing means 101, picture group quantizer step size 
computing means 102, quantizer step size adjusting means 103, and a 
quantizer step size selector 104. 

In the complexity measure computing means 101, the picture 
group complexity measure in a plurality of pictures and the complexity 

20 measure in all pictures for which encoding was performed are computed, 
using the input bit stream quantizer step size and input bitstream 
number of bits supplied for each macro block from the de-encoding path 
section 11; and are supplied to the picture group quantizer step size 
computing means 102. 

25 In the picture group quantizer step size computing means 102, the 

base quantizer step size is computed, using the frame rate supplied 
from the de-encoding path section 11, the target average bit rate 
supplied from outside, and the complexity measure and picture group 
complexity measure supplied from the complexity measure computing 

30 means 101; and the result of the computation is supplied to the 
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quantizer step size adjusting means 103. 

In the quantizer step size adjusting means 103, the target number 
of bits is set, using the input bit stream bit rate and frame rate, and 
input bitstream number of bits, supplied from the de-encoding path 
5 section 11, and the target average bit rate supplied from outside, the 
difference from the post-re-encoding number of bits supplied from the 
encoding path section 13 is found, adjustment of the base quantizer step 
size supplied from the picture group quantizer step size computing 
means 102 is performed according to the difference, and the adjusted 

10 quantizer step size is supplied to the quantizer step size selector 104. 

In the quantizer step size selector 104, if the quantizer step size 
supplied from the quantizer step size adjusting means 103 is smaller 
than the input bit stream quantizer step size supplied from the de- 
encoding path section 11, the input bit stream quantizer step size is 

15 supplied to the encoding path section 13. 
Operation of first Embodiment 

Next, an example of the operation in the rate control means 14 of 
the present invention will be described. Equations (1) to (16) shown 
below are examples of the processing in complexity measure 

20 computation, and these equations represent examples of the processing 
in the complexity measure computing means 101. In this complexity 
measure computing means 101, the quantizer step size cumulative 
value Qop, a number of bits cumulative value Sop, and complexity 
measure Xp of a picture group in a plurality of pictures, and the 

25 quantizer step size cumulative value Qot, a number of bits cumulative 
value Sot, and complexity measure Xt in all pictures, are computed by 
means of equations (1) to (6), for example, using the input bit stream 
quantizer step size Qoj and input bitstream a number of bits Soj 
supplied for each macro block from the de-encoding path section 11; and 

30 the picture group complexity measure Xp and complexity measure Xt 
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are supplied to the picture group quantizer step size computing means 
102, Here, symbol Np denotes the number of pictures in the picture 
group, symbol Nt denotes the total number of pictures for which 
encoding is performed, and symbol Nmb denotes the number of macro 
5 blocks per picture. 

Npx Nmb 

Qop= Z Qoj (1) 

j=i 
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Npx Nmb 

Sop= Z Soj (2) 



Qop X Sop 
Np^ X Nmb 



Npx Nmb 

Qot= X Qoj (4) 

j=i 



Npx Nmb 

15 Sot= X Soj (5) 



Xt = ^f^ (6) 

Nt' xNmb 



In the picture group quantizer step size computing means 102, the 
20 base quantizer step size Qb is computed by means of equation (7), for 
example, using the frame rate FR supplied from the de-encoding path 
section 11, the target average bit rate ABR supplied from outside, and 
the complexity measure Xt and picture group complexity measure Xp 
supplied from the complexity measure computing means 101; and is 
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supplied to the quantizer step size adjusting means 103. Here, min (Xt, 
Xp) selects the minimum values of Xt and Xp. In the above described 
computation, long-term scene characteristics of the input bit stream, 



5 comparison of complexity measures, and selecting a small value 
provides control whereby a large number of bits is generated, enabling a 
decrease in picture quality to be suppressed. 



In the quantizer step size adjusting means 103, the picture group 
number of bits cumulative value Sop, picture group target number of 
bits Tp, and target number of bits of all pictures Tt, are computed by 
means of equation (2) above and equations (8) and (9) below, for 

15 example, using the input bit stream bit rate BR and frame rate FR, and 
input bit stream number of bits Soj, supplied from the de-encoding path 
section 11, and the target average bit rate ABR supplied from outside. 
Also, the number of bits cumulative value for all pictures Srt is 
computed by means of equation (10), using the post-re-encoding number 

20 of bits Srj supplied for each macro block from the encoding path section 
13, and the difference VBO is found from equation (11). Moreover, 
adjustment of the base quantizer step size Qb supplied from the picture 
group quantizer step size computing means 102 is computed by means 
of equation (12), for example, and the quantizer step size Qm on which 

25 adjustment has been performed is supplied to the quantizer step size 
selector 104. 



and shorter-period scene characteristics, are realized by performing a 



Qb = 



min(Xt,Xp)xFR 
ABR 



(7) 
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Tp = 



ABR X Sop 
BR 



(8) 





Tt=ZTp 



(9) 



Srt= E Srj 



NpxNmb 



(10) 



VBO=Srt-it 



(11) 



Qm = 



Qbx(a + VBO) 



(12) 



r 



Here, equation (9) above is the cumulative value of the picture 
group target number of bits Tp, and in equation (12) symbols a and r are 
parameters that determine the size of the control reaction for the 
difference of the generated number of bits corresponding to the target 
average bit rate. 

In the quantizer step size selector 104, if the quantizer step size 
Qm supplied from the quantizer step size adjusting means 103 is 
smaller than the input bit stream quantizer step size Qj supplied from 
the de-encoding path section 11, the input bit stream quantizer step size 
Qj is supplied to the encoding path section 13. 

Second Embodiment 

Next, a second embodiment of the present invention is shown in 
Fig. 2. In the first embodiment, in the complexity measure computing 
means 101 the complexity measure and picture group complexity 
measure are computed using the input bit stream quantizer step size 
and input bit stream number of bits supplied from the de-encoding path 
section 11. According to this embodiment, in the complexity measure 
computing means 101 the complexity measure and picture group 
complexity measure are computed using the post-re-encoding quantizer 



step size and post-re-encoding number of bits supplied from the 
encoding path section 13. 

Third Embodiment 
5 Next, a third embodiment of the present invention is shown in Fig. 

3. In the first embodiment, in the quantizer step size selector 104 
quantizer step size selection is performed using the quantizer step size 
supplied from the quantizer step size adjusting means 103. In this 
embodiment, adaptive quantization means 901 is added to the block 

10 diagram shown in Fig. 1. In the adaptive quantization means 901, the 
quantizer step size supplied from the quantizer step size adjusting 
means 103 is further adjusted using the input bit stream quantizer step 
size and input bitstream number of bits supplied from the de-encoding 
path section 11, and is supplied to the quantizer step size selector 104. 

15 Next, an example of the operation of the adaptive quantization 

means 901 will be described. In the adaptive quantization means 901, 
the quantizer step size Qa is computed by means of the picture group 
complexity measure Xp obtained from equation (3), and equation (13) 
below, for example, using the input bit stream quantizer step size Qj 

20 and a number of bits Sj supplied from the de-encoding path section 11, 
and the quantizer step size Qm supplied from the quantizer step size 
adjusting means 103, and is supplied to the quantizer step size selector 
104. Here, the number of pictures in the picture group, Np, need not be 
the same as the number of pictures in the picture group used by the 

25 complexity measure computing means 101. In this embodiment, 
computation of activity performed using a normal image signal is 
performed using the input bit stream quantizer step size and a number 
of bits, and the quantizer step size is corrected. As a result, adaptive 
quantization that uses the properties of the image can be performed 

30 even for a compressed moving picture re-encoding apparatus with a 



configuration whereby de-encoding is not performed as far as the image 
signal level. 

Xp 

Fourth Embodiment 

Next, a fourth embodiment of the present invention is shown in 
Fig. 4. In the first embodiment, in the complexity measure computing 
means 101 the input bit stream quantizer step size is used for 

10 complexity measure computation. In this embodiment, an inverse 
adaptive quantizer 1001 is added to the block diagram shown in Fig. 1. 

In the inverse adaptive quantizer 1001, the input bit stream 
quantizer step size supplied from the de-encoding path section 11 is 
adjusted, using the bit stream quantizer step size and input bitstream 

15 number of bits supplied from the de-encoding path section 11, and is 
supplied to the complexity measure computing means 101. As an 
example of the operation of the inverse adaptive quantization means 
1001, inverse conversion of the adaptive quantization means 901 in Fig. 
3 can be considered, for instance. In this embodiment, for complexity 

20 measure computation, the input bit stream quantizer step size is 
adjusted using the input bit stream quantizer step size and the input bit 
stream number of bits. As a result, it is possible to estimate the pre- 
adaptive-quantizer step size even for the quantizer step size of an input 
bit stream on which adaptive quantization is performed at the time of 

25 encoding, and complexity measure computation using the pre-adaptive- 
quantizer step size is made possible. 

Fifth Embodiment 

Next, a fifth embodiment of the present invention is shown in Fig. 



5. In this embodiment, external input for the quantizer step size 
selector 104 is added to Fig. 1. In the quantizer step size selector 1101 
of the first embodiment, if the quantizer step size supplied from the 
quantizer step size adjusting means 103 is smaller than the input bit 

5 stream quantizer step size supplied from the de-encoding path section 
11, the input bit stream quantizer step size is supplied to the encoding 
path section 13. In the quantizer step size selector 1101 of this 
embodiment, in addition to the above described input, the minimum 
quantizer step size is supplied from outside, and if the quantizer step 

10 size supplied from the quantizer step size adjusting means 103 and the 
input bit stream quantizer step size are smaller than the minimum 
quantizer step size, the minimum quantizer step size is supplied to the 
encoding path section 13. By this means, in this embodiment it is 
possible to suppress the generation of unnecessary code resulting from 

15 setting too small a quantizer step size. 

Sixth Embodiment 

Next, a sixth embodiment of the present invention is shown in Fig. 

6. In this embodiment, maximum bit rate quantizer step size 
20 computing means 1201 is added to the block diagram shown in Fig. 1. 

In the maximum bit rate quantizer step size computing means 1201, a 
maximum bit rate quantizer step size is set so that the specified 
maximum bit rate is not exceeded, using the input bit stream quantizer 
step size, input bitstream number of bits, and input bit stream bit rate 

25 and frame rate, supplied from the de-encoding path section 11, the 
post-re-encoding quantizer step size and post-re-encoding number of 
bits supplied from the encoding path section 13, the maximum bit rate 
supplied from outside, and so forth, and is supplied to the quantizer 
step size selector 104. 

30 In the quantizer step size selector 1202, in addition to the above 
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described input, if the quantizer step size supplied from the quantizer 
step size adjusting means 103 using the maximum bit rate quantizer 
step size supplied from the maximum bit rate quantizer step size 
computing means 1201 and the input bit stream quantizer step size are 
5 smaller than the maximum bit rate quantizer step size, the maximum 
bit rate quantizer step size is supplied to the encoding path section 13. 
Here, computation of the maximum bit rate quantizer step size in the 
maximum bit rate quantizer step size computing means 1201 can be 
implemented, for example, by setting the target number of bits using 

10 the ratio of the input bit stream bit rate to the maximum bit rate and 
the number of bits of the input bitstream, and computing the macro 
block unit quantizer step size using rate control that meets the target 
number of bits. In this embodiment, if the bit rate of the input bit 
stream is extremely high, and the target average bit rate is low, it is 

15 possible to suppress the generation of unnecessary code resulting from 
setting a smaller than necessary encoding width. 

Seventh Embodiment 

Next, a seventh embodiment of the present invention is shown in 

20 Fig. 7. In this embodiment, the rate control means 14 is configured by 
complexity measure computing means 101, picture group quantizer step 
size computing means 102, quantizer step size adjusting means 103, a 
quantizer step size selector 104, average quantizer step size computing 
means 1301, and addition value computing means 1302. 

25 Only the parts that differ from the first embodiment will now be 

described below. In the average quantizer step size computing means 
1301, the input bit stream quantizer step sizes supplied from the de- 
encoding path section 11 are accumulated for a plurality of picture 
periods, and the average value is supplied to the addition value 

30 computing means 1302. 
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In the addition value computing means 1302, the difference 
between the base quantizer step size supplied from the picture group 
quantizer step size computing means 102 and the average quantizer 
step size supplied from the average quantizer step size computing 
means 1301 is added to the input bit stream quantizer step size 
supplied from the de-encoding path section 11, and is supplied to the 
quantizer step size adjusting means 103. 

Next, an example of the operation of the average quantizer step 
size computing means 1301 and addition value computing means 1302 
will be shown. In the average quantizer step size computing means 
1301, the average quantizer step size Qave is computed by means of 
equation (1) above and equation (14) below, using the quantizer step 
size Qj supplied from the de-encoding path section 11, and is supplied to 
the addition value computing means 1302. Here, the number of 
pictures in the picture group, Np, need not be the same as the number of 
pictures in the picture group used by the complexity measure computing 
means 101. 



In the addition value computing means 1302, the addition value A 
is computed by means of equation (15) below, for example, using the 
quantizer step size Qb supplied from the picture group quantizer step 
size computing means 102 and the average quantizer step size Qave 
supplied from the average quantizer step size computing means 1301, 
and is supplied to the quantizer step size adjusting means 103. Thus, 
in this embodiment, as an addition value is added to the input bit 
stream quantizer step size, if the quantizer step size has been set using 
adaptive quantization at the time of encoding, the quantizer step size 



Qave = 



Qop 



(14) 



Np 
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can be set without considering adaptive quantization. 

If Qb-Qave>0, then A=Qb-Qave (15) 
else A==0 

Eighth Embodiment 

Next, an eighth embodiment of the present invention is shown in 
Fig. 8. In this embodiment, external input to the addition value 
computing means 1302 is added to Fig. 7. In the addition value 

10 computing means 1302 of the seventh embodiment, the difference 
between the base quantizer step size supplied from the picture group 
quantizer step size computing means 102 and the average quantizer 
step size supplied from the average quantizer step size computing 
means 1301 is added to the input bit stream quantizer step size 

15 supplied from the deencoding path section 11, and the quantizer step 
size is computed. 

In the addition value computing means 1401 of this embodiment, 
in addition to the above described input, a minimum quantizer step size 
or threshold value is supplied from outside. In the addition value 

20 computing means 1401, quantizer step size selection is performed by 
comparing the computed quantizer step size with the quantizer step size 
or threshold value, and the quantizer step size is supplied to the 
quantizer step size adjusting means 103, 

An example of the operation of the addition value computing 

25 means is shown in Fig. 9. Fig. 9 shows which quantizer step size is 
selected when a minimum quantizer step size and threshold value have 
been set. The horizontal axis represents the input bit stream 
quantizer step size, and the vertical axis represents the post-re- 
encoding quantizer step size. The bold line in the graph is the 

30 quantizer step size selected by means of this quantizer step size setting. 
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Here, the minimum value of the quantizer step size is set 
according to the minimum quantizer step size, and from a certain 
quantizer step size onward according to the threshold value, a quantizer 
step size is set so that the post-re-encoding quantizer step size does not 
5 exceed the threshold value until the input bit stream quantizer step size 
exceeds the threshold value. By this means, in this embodiment the 
generation of an excessive the number of bits is suppressed by setting 
the minimum value of the post-re-quantization quantizer step size. 
Also, selection of a quantizer step size greater than the threshold value 
10 is prevented, and deterioration of the picture quality is suppressed. 

Ninth Embodiment 

Next, a ninth embodiment of the present invention will be 
described. In the seventh and eighth embodiments, the same addition 

15 value is added to the input bit stream quantizer step size regardless of 
the encoding prediction method. In the ninth embodiment, an addition 
value is held for each picture encoding prediction method. For example, 
for MPEG-2 intra-frame encoding (I-picture), forward inter-frame 
encoding (P-picture), and bidirectional inter-frame encoding (B-picture), 

20 an average quantizer step size Qave same as seventh Embodiment is 
computed for each encoding mode by the average quantizer step size 
computing means 1301, and is supplied to the addition value computing 
means 1302. 

In the addition value computing means 1302, the difference 
25 between the base quantizer step size supplied from the picture group 
quantizer step size computing means 102 and the average quantizer 
step size for each encoding mode supplied from the average quantizer 
step size computing means 1301 is computed, and is added to the input 
bit stream quantizer step size supplied from the de-encoding path 
30 section 11 for each encoding mode, and quantizer step size computation 



is performed. Thus, in this embodiment, as the addition value is 
switched according to the encoding mode, finer control is possible than 
with a single addition value, and the picture quality can be improved. 

5 Operation of Embodiments 

In the above described all embodiments, the situation where, for 
example, compressed moving picture stream 1, which is the input, is 
re-enencoded, and compressed moving picture stream 2 is output, is 
considered. Fig. 10 shows the relationship between the average 
10 quantizer step size and time per picture in compressed moving picture 

0 stream 1 and post-re-encoding compressed moving picture stream 2, and 
^ J Fig. 11 shows an example of the relationship between the generated the 

1 H number of bits and time at this time. The thin solid line in Fig. 10 and 
!T Fig. 11 represents compressed moving picture stream 1. 

^ J 15 In general, a reduction of the number of bits can be achieved by 

H setting a larger quantizer step size than the quantizer step size in 

!' LI 

ry compressed moving picture stream 1 and performing re-quantization. 

J 2 With conventional methods, the target number of bits at the time of re- 

encoding is set according to the number of bits of compressed moving 
20 picture stream 1, and the quantizer step size is set. In a case such as 
that shown in Fig. 11, for example, since a virtually defined number of 
bits must be reduced in any period, the quantizer step sizes are 
uniformly set as large values. As a result, as shown by the dashed line 
in Fig. 10, even for a picture with a large input compressed moving 
25 picture stream quantizer step size and poor picture quality, an even 
larger value is set at the time of re-encoding, causing a deterioration in 
picture quality. This kind of problem can be solved by setting the 
quantizer step size according to the moving picture scene characteristics, 
as shown by the bold line in Fig, 10. In the present invention, the 
30 moving picture scene characteristics are found using encoding 
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information contained in the input compressed moving picture stream, 
and the quantizer step size is set according to the characteristics. 

Next, correction is performed for the set quantizer step size, using 
the difference between the target number of bits found using the 
5 average bit rate, etc., and the actual number of bits. As a result, 
control can be achieved whereby the picture quality is constant for a 
given period, the average bit rate is attained, and the target number of 
bits is approached. Also, by ensuring that the quantizer step size does 
not become smaller than the quantizer step size of the input compressed 

10 moving picture stream, a more balanced improvement in picture quality 
can be achieved, without allocating unnecessarily large code quantities. 
With the present invention, moreover, since the entire compressed 
moving picture stream is once de-encoded, and re-encoding is performed 
without finding the moving picture characteristics, it is possible to 

15 implement real-time processing with little delay. 

The above described embodiments are examples of the preferred 
embodiments of the present invention. However, the present invention 
is not limited to the above described embodiments, and various 
embodiments are possible within the scope of the essentials of the 

20 present invention. 

As is apparent from the above description, in a compressed moving 
picture re-encoding apparatus and compressed moving picture re- 
encoding method according to the present invention, a quantizer step 
size that is used in re-encoding is computed, the computed quantizer 

25 step size and the quantizer step size in the input compressed moving 
picture stream are input, and the quantizer step size that is used in 
actual re-encoding is output. Thus, by finding the moving picture 
scene characteristics using encoding information contained in the input 
compressed moving picture stream, performing quantizer step size 

30 setting according to the characteristics, and performing correction for 
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the set quantizer step size using the difference between the target 
number of bits and the actual number of bits, and control can be 
achieved whereby the picture quality is constant for a given period, the 
average bit rate is attained, and the target number of bits is approached. 
By this means, high-picture-quality re-encoding can be achieved. Also, 
since the entire compressed moving picture stream is once deenencoded, 
and re-encoding is performed without finding the moving picture 
characteristics, it is possible to achieve compressed moving picture 
stream re-encoding with little delay and in real time. 



